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Many students exhibit a special type of learning disability in writing. Yet, 
teachers spend relatively little time helping children and youth with severe 
writing difficulties overcome their struggles or prevent emerging problems 
from becoming more severe. A major reason for this lack of attention is 
that many educators feel overburdened by the complex task of teaching 
students how to compose meaningful texts. The purpose of this explorative 
study was to determine the extent to which certain theory-based text- and 
person-related variables influence the way a written story is rated by ex¬ 
perts and subsequently enable practitioners to make more informed deci¬ 
sions about where to start in supporting struggling writers. Sixty German 
secondary students (ages 10-13 years old) wrote stories that were evalu¬ 
ated by eight independent raters. Structural equation models were then 
used to examine the relationships between seven dependent variables and 
the quality of the texts. The analysis showed that rather short and illegible 
stories were generally rated unfavorable. Other factors (e.g., performance 
on alphabetic and copying tasks or spelling skills) also played a role, but 
to a lesser extent. These findings provide teachers with useful informa¬ 
tion about where to start when trying to prevent learning disabilities in 
writing. In particular, educators should focus on instructing students 
(a) how to brainstorm story ideas in order to enable them to produce 
texts of an acceptable length and (b) on how to improve the legibility of 
their handwriting. 
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Introduction 

Being able to put one’s thoughts on paper is a critical skill for success in 
school and later professional endeavors. As soon as students have acquired basic 
writing skills, they are under constant demand to demonstrate their academic 
competence through the written texts they produce. In other words, possessing 
content knowledge is not enough. One needs also to be able to express the in¬ 
formation in a form that is comprehensible to the reader. 

Children learn these processes by composing simple stories at the end 
of their elementary education. Around the age of 10, they gradually develop the 
skills necessary to produce more refined texts, like compare/contrast essays, ar¬ 
gumentative treatises, and other kinds of more complex genres (Becker-Mrotzek 
& Bottcher, 2012). Acquiring solid writing competencies is not only impor¬ 
tant in language classes, it is also vital for demonstrating knowledge on writ¬ 
ten exams, for example, in natural sciences. Without ample abilities to “think 
on paper,” students are bound to fail in a great variety of subjects (Griinke & 
Leonard-Zabel, 2015). 

Competence in composing text, or rather, the ability to transfer ideas 
or information into a linguistic form while following conventional patterns 
of achieving a communicative goal with a specific audience is as important as 
it is challenging (Graham & Harris, 2005). Indeed, according to Kame’enui 
and Simmons (1990), it is “the most complex of language skills...” [and] the 
last to develop in the sequence of listening, speaking, reading, and writing” 
(p. 420). Thus, text composition requires brain-based components such as in¬ 
tact attention and concentration, spatial and sequential production, memory, 
higher-order cognition, language competencies (including adequate vocabulary, 
grammatical structures, and orthography), as well as executive functioning (Feif- 
er & De Fina, 2002). 

In their well-known theory, Hayes and Flower (1980) describe the pro¬ 
cesses that a person undergoes in the course of writing, which can be roughly 
subdivided into idea generation, planning, translating, executing and review¬ 
ing. In later elaborations of this model, Hayes (1996, 2006, 2012) incorporated 
supplemental social and affective elements (e.g., problem solving, text interpre¬ 
tation, embedded reflection), further illustrating the intricacy that is involved in 
text production. Hayes especially stressed the importance of effectively coping 
with complexity in ever-changing new writing challenges. 

Bereiter and Scardamalia (1987) provided an explanation of how 
novices can gradually master these highly demanding text production tasks, in¬ 
cluding the significance of increasing the fluency of the linguistic processes in or¬ 
der to lessen the demands on a person’s memory system when it tries to hold and 
manipulate a large amount of information simultaneously. Along these lines, 
Berninger and Swanson (1994) proposed a model that highlights the mean- 
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ingful role that transcription skills play on the way to becoming a proficient 
writer, especially spelling and motor skills. Without fluency, the more mechani¬ 
cal aspects of execution make the writing process even more demanding, usually 
resulting in brief texts (Bereiter & Scardamalia, 1987; Kreiner, 1996; Van der 
Hoeven, 1999). 

Several studies have suggested that students who do not demonstrate the 
above skills to a sufficient degree often produce texts that are considered inad¬ 
equate by teachers and other expert raters. That is, if the ability to simultaneously 
hold in memory and manipulate a large amount of information and to cope with 
complexity in novel situations is low, the resulting texts are viewed as being of 
relatively meager quality (e.g., Berninger et ah, 2010). When students make a 
comparatively large number of spelling errors, their writing products do not get 
rated very favorably either, (e.g., MacArthur & Graham, 1987). The same is true 
for students whose handwriting is poor and, therefore, submit texts that are dif¬ 
ficult to decipher (e.g., Greifeneder, Zelt, Seele, Bottenberg, & Alt, 2012; Rose, 
2009). Finally, if students lack the stamina or the knowledge to elaborate on a 
subject and hence compose proportionally short writing products, their texts are 
generally also evaluated rather negatively (Englert & Raphael, 1988). 

A great number of children and youth have severe problems with 
mastering the task of composing a meaningful text. If these difficulties persist 
over time and reach a critical stage, they are seen as an expression of a specific 
learning disability in writing. Referring to the Diagnostic and Statistical Man¬ 
ual of Mental Disorders (American Psychiatric Association, 2013), Hahn and 
Morgan (2014) described these students as having writing skills (measured by 
individually administered tests) that fall substantially below those expected given 
the individual’s chronological age, intelligence, and age-appropriate education 
(i.e., delays of two years or more). School-based epidemiological studies have 
documented that the prevalence of children and youth with learning disabili¬ 
ties in writing is even greater than those with dyslexia or dyscalculia (Mayes & 
Calhoun, 2006). Different studies suggest that up to 15% of all students exhibit 
this kind of disorder (Katusic, Colligan, Weaver, & Barbaresi, 2009). 

Given these statistics, it is important that teachers support children and 
youth in improving their ability to first author simple stories and later attend 
to more sophisticated linguistic text forms. This is anything but easy, however. 
As stated above, writing is a very complex neurodevelopmental process, and 
its intricacy and unique nature make it difficult to determine exactly what to 
teach (Anderson & Keel, 2002; Kaufer, Hayes, & Flower, 1986; Ortega, 2009; 
van Wijk & Sanders, 1999). To educators, the task of imparting the knowledge 
and skills to compose a meaningful text, therefore, often appears overwhelming 
(Troia & Graham, 2003). As a consequence, this vital part of schooling gets 
pushed “to the dusty corners of the classroom” (Schlagal, 2013, p. 257). 
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To remedy this dilemma, we need reliable information about which 
problems and skills practitioners have to focus on in order to help students pro¬ 
duce texts of acceptable quality. 

Purpose of This Study and Research Questions 

The theoretical models described above provide answers to the question 
of what skills and competencies are needed to effectively put one’s thoughts on 
paper. However, we still do not know much about the extent to which a specific 
factor contributes to being able to compose an acceptable writing product. To 
our knowledge, the variables highlighted earlier have never been incorporated 
into one study aimed at providing information about the significance that each 
of these elements plays in creating a text that gets rated positively by experts. 

From the major relevant theories of writing development and the corre¬ 
sponding empirical studies (see above), we have gained an understanding of the 
importance of sufficient skills in spelling, handwriting, producing longer pieces 
of work, and coping with complexity in novel situations for creating an appeal¬ 
ing text. However, we do not know much about how these factors relate to each 
other and which factor(s) is/are considered more crucial than others. 

To fill this void in the literature, this study was designed to determine 
the extent to which the aforementioned variables are relevant for producing an 
acceptable piece of writing and in which way(s) they are connected with each 
other. Story writing was chosen, because this is the genre that students use from 
the very beginning of their writing careers (see above). If they have not devel¬ 
oped ample competencies in authoring a simple narrative, they will not be able 
to proceed to more advanced levels of writing (Graham & Harris, 2005). 

In order to systematize the relevant variables, we divided them into 
two categories: 

(1) text-related factors that can be directly detected on the basis of 
a story produced by a student (by assessing the handwriting, by 
counting the number of words, and by calculating the ratio of or¬ 
thographical errors) and 

(2) person-related factors (fluency in handwriting and ability to cope 
with complexity in novel situations) that have to be measured in¬ 
dependently. 

The study was explorative in nature and was designed to gain insight 
into the roles that these variables play for children aged 10 and a little older 
when they try to produce stories of acceptable quality (as rated by experts). 

Method 

Participants 

Comprehensive school students. We assessed a total of 60 students 
- 34 boys and 26 girls. Most of them were 11 (N = 29) or 12 (N = 23) years 
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old. The remaining eight students were 10 (N = 4) and 13 (N = 4) years old. 
All attended an inclusive comprehensive school in a major city in Northrhine- 
Westfalia (Germany) that served grades 5 through 13. They were either in fifth 
(N = 36) or sixth grade (N = 24). According to their teachers, about 20% of 
the students came from an immigrant background. A little more than 5% of 
them had some type of special educational need (learning disabilities, behavioral 
problems, mild mental retardation, and/or autism spectrum disorders). Due to 
the lack of a suitable standardized test in German, we were not able to determine 
the number of girls and boys who exhibited a learning disability in writing or 
were at risk of developing one. However, the respective class teachers esti¬ 
mated that about a quarter of their students demonstrated major problems in 
composing text. 

Raters. Each story that was subject to our analysis was evaluated by 
eight independent expert raters. For this purpose, we recruited 192 college stu¬ 
dents from a large German university (31 males and 161 females). All of them 
were enrolled in an undergraduate program in special education and had at least 
rudimentary experience in assessing and teaching children after completing an 
internship in a special school for slow learners for six weeks. Their ages ranged 
from 18 to 44 (M = 23.38; SD = 3.88). 

Measures 

Independent variable. We used a subtest from the General German 
Language Test (GGLT; Steinert, 2011), in which subjects were to write a story 
about a drawing that was presented to them. The drawing showed a man climb¬ 
ing up a ladder to a balcony, while a woman watched him from a window in a 
neighboring house. There were no time limits for finishing the task. 

To evaluate the written products, we applied a German version of the 
National Association of Educational Progress (NAEP) Writing Scale for nar¬ 
rative texts (Canz, 2015). This evaluation grid developed by the NAEP (Na¬ 
tional Center of Education Statistics, 2011) is one of the most widely used and 
valid instruments for large-scale writing assessment (Lee & Stankov, 2012). The 
rubric consists of a set of six descriptions that characterize stories of different 
quality levels. They address common criteria for evaluating texts like coherence, 
word choice, and structure. When using the NAEP Writing Scale, a rater assigns 
one of the six quality levels to a given writing product (with “ 1 ” being the high¬ 
est and “6” being the lowest ranking). To determine the extent of agreement 
between the eight judges, we applied Krippendorff s alpha (Krippendorffi 2011) 
as an inter-rater coefficient. The overall reliability was .78. Such a value can be 
considered as high (Krippendorff, 2004). 

Dependent variables. The length of each story was evaluated by count¬ 
ing the number of words. In addition, the percentage of spelling errors was de¬ 
termined. To measure handwriting fluency, we asked the students to record the 
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letters of the alphabet as fast as possible (alphabet task), as well as to transcribe 
a given text as quick as possible (copying task). In each case, participants were 
stopped after 3 minutes. This twofold way to quantify handwriting fluency is 
rather common (Barnett, Henderson, Scheib, & Schulz, 2009). The reason be¬ 
hind this distinction is the fact that alphabet tasks are generally more strenuous 
than copying tasks, because the activation of long-term memory may increase 
the cognitive load of the child’s working memory (Graham, Struck, Santoro, & 
Berninger, 2006; McCutchen, 2000). By considering both kinds of tasks, we 
tried to cover all aspects of handwriting fluency. Two special education students 
from a large German university independently counted the number of words, 
the spelling mistakes, the letters in the alphabet task, and the words in the copy¬ 
ing task. The level of agreement between the two raters equaled 100%. 

To evaluate the neatness of handwriting, we applied a rating protocol 
developed by Mahrhofer (2004) consisting of 13 subscales that provide informa¬ 
tion about different aspects of the neatness of a child’s script, while taking the 
respective grade level into account. The results are then expressed through two 
indices — one for legibility and one for uniformity. According to Mahrhofer, the 
overall reliability of the instrument is .87 (Cronbach’s alpha). The handwriting 
evaluation was performed independently by the first and fourth authors. Intra¬ 
class correlation coefficients (ICC) were .98 for legibility and .95 for uniformity. 

Students’ ability to cope with complexity in novel situations was mea¬ 
sured using the German Number Combination Test (NCT; Oswald & Roth, 
1987). The NCT is a trail-making instrument. On four different sheets, partici¬ 
pants must connect randomly positioned numbers from 1 to 90 in the correct 
order as fast as possible within a 1 -minute time limit. Results are expressed as the 
mean quantity of correctly connected numbers. According to the manual, the 
test-retest reliability of the NCT varies between .84 and .97. It correlates highly 
with standard psychometric tests of intelligence (Rammsayer & Stahl, 2007). 
Procedures 

Five examiners participated in administering the test battery in the 
school. One held a doctorate, one held a master’s degree in special education, a 
third was a graduate student, and the remaining two were undergraduate stu¬ 
dents in special education at a large German university. The data was collected 
during the course of a school day during regular classroom activities. 

The 192 undergraduate students described above graded the stories 
that the students had written about the drawing from the GGLT. These raters 
had previously been instructed in groups of about 20 each on how to use the 
NAEP Writing Scale during 45-minute training sessions. As part of the train¬ 
ing, they were provided with several examples of very well, mediocre, and poorly 
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written narratives that had been appraised by experts. Subsequently, the raters 
were given five sample stories to evaluate for themselves. They received feedback 
on how well they took the assessment criteria of the NAEP Writing Scale into 
consideration. Each text was then independently rated by eight undergraduate 
students. The means of these appraisals served as a measure of narrative quality. 

Results 

Table 1 provides descriptive values for all variables. In terms of skewness 
(Skew) and kurtosis (CK), all of them (except for words copied) show a normal 
distribution. Words copied were strongly compressed to the right side of the 
distribution (a prolonged tail to the left) with a steep peak. After squaring, the 
variable kurtosis was 0.1 and skewness -0.1. Therefore, the squared values were 
kept for all further analyses. 

Table 1. Descriptives for NAEP Values and Indicators on the Text, and Student 
Level 


Measure 

M 

SD 

Median 

Min 

Max 

Skew 

Kurtosis 

SE 

NAEP value 

2.83 

1.06 

2.75 

1.00 

5.57 

0.33 

-0.34 

0.14 

Total words 

100.37 

45.16 

99.00 

26.00 

227.00 

0.54 

-0.19 

5.83 

Letters of 









the alphabet 
copied 

48.11 

16.47 

48.33 

0.00 

76.00 

-0.55 

-0.01 

2.13 

Words copied 

38.92 

9.32 

40.00 

0.00 

56.00 

-1.30 

3.45 

1.20 

NCT 

29.63 

5.83 

28.50 

16.50 

45.00 

0.31 

0.03 

0.75 

Legibility 

3.42 

1.10 

3.00 

0.00 

5.00 

-0.47 

0.18 

0.14 

Uniformity 

3.08 

0.76 

3.00 

2.00 

5.00 

0.40 

-0.25 

0.10 

Error ratio 

12% 

9% 

9% 

0% 

35% 

0.81 

-0.52 

1% 


The inter-correlations of all variables are shown in Table 2. All cor¬ 
relations to the NAEP value were as expected: The total number of words and 
legibility of the texts were strongly correlated, the copying speed of the letters of 
the alphabet, the copying speed of words, the uniformity of the writing, and the 
ratio of orthographic errors were moderately correlated, whereas NCT values 
were only weakly correlated. All correlations were in the expected direction. 

Besides the NAEP values, the other measures showed a complex pattern 
of correlations. The two copying speed measures (letters of the alphabet and 
words) were strongly correlated as were the two measures for handwriting (leg¬ 
ibility and uniformity). NCT values showed weak to mild correlations with the 
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word and alphabet copying measures and only a weak correlation to the ratio 
of orthographical errors. Orthographical error ratio was moderately to strongly 
correlated to legibility and uniformity of handwriting. This complex pattern of 
correlations among all variables made it necessary to analyze an integrated statis¬ 
tical model based on multiple regression. 

Table 2. Correlations Between NAEP Values and Indicators on the Text and 
Student Level 


Measure 

1 

2 

3 

4 

5 

6 

7 

8 

1. NAEP value 

- 

-.63* 

-.41* 

-.40* 

-.25 

-.52* 

-.37 

.43* 

2. Total words 

-.63* 

- 

.53* 

.59* 

.13 

.44* 

.27 

-.05 

3. Letters of the 
alphabet copied 

-.41* 

.53* 

_ 

.61* 

.32 

.32 

.14 

-.15 

4. Words copied 

-.40* 

.59* 

.61* 

- 

.29 

.21 

.05 

-.12 

5. NCT 

-.25* 

.13 

.32* 

.29* 

- 

.00 

-.08 

.01 

6. Legibility 

-.52* 

.44* 

.32* 

.21 

.00 

- 

.57* 

-.46* 

7. Uniformity 

-.37* 

.27* 

.14 

.05 

-.08 

.57* 

- 

-.41* 

8. Error ratio 

.43* 

-.05 

-.15 

-.12 

.01 

-.46* 

-.41* 

- 


Note. *p < .05. Indicators of significance above the diagonal are corrected for mul¬ 
tiple tests following the Holm correction (Holm, 1979). 

We set up three structural equation models (SEM) for an exploratory 
analysis of the model structure. The first model assumed that all manifested 
variables construed a single latent factor explaining the NAEP results (1-fac¬ 
tor model). The second model assumed two separate latent factors explaining 
the NAEP results (2-factor model), where the first factor comprised all person- 
related manifest variables (alphabet letter copying speed, word copying speed, 
NCT results) and the second factor indicated all text characteristics (uniformity 
and legibility of the handwriting, ratio of spelling errors, and number of words). 
The third model assumed the two latent factors in a mediation context (2-factor 
mediation model), where the person factor influenced the text factor, which in 
turn influenced the NAEP results. That is, we assumed that there would be no 
direct connection between the person factor and the NAEP results. 

The models were analyzed using the R package lavaan (Rosseel, 2012). 
We estimated the SEMs with a maximum likelihood procedure. Due to a high 
variation in variance, all exploratory variables were standardized for this analysis. 
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Figure 1. Three explorative structure equation models (SEM). Path values are 
standardized. 
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Table 3. Fit Indices of the Three Models 


Model 

X 2 

df 

P 

CFI 

TLI 

AIC 

BIC 

RMSEA 

SRMR 

1 factor 

69.4 

20 

<.01 

0.68 

0.55 

1272 

1306 

0.20 

0.13 

2 factors 

52.9 

18 

<.01 

0.77 

0.65 

1260 

1298 

0.18 

0.11 

2 factors 
mediation 

53.0 

19 

<.01 

0.78 

0.68 

1258 

1294 

0.17 

0.11 


All three models showed acceptable fit indices (see Table 3). However, 
the two 2-factor models produced the best model fit (1-factor vs. 2-factor mod¬ 
el: Ay 2 (2) = 16.4, p < .01). Moreover, the mediation model had a nearly identi¬ 
cal fit to the model without mediation (2-factor mediation vs. 2-factor: Ay 2 (1) 
= 0.07, p > .78). As the mediation model is sparser, it might be preferred over 
the model without mediation. This argument is strengthened by the fact that 
within the model without mediation, the latent person factor had virtually no 
direct influence on the NAEP results (see Figure 1). 

Discussion 

Main Findings 

In this study, we addressed the question of which text- and person-relat¬ 
ed factors seem to have a bearing on the quality of a story written by children of 
10 years of age or a little older. The results of this explorative assessment indicate 
that length and legibility play prominent roles: The longer and the more legible 
a text is, the higher its (rated) quality. To a lesser extent, a low ratio of spelling 
errors and a high uniformity of handwriting are also associated with a higher 
level of excellence of a narrative. In addition, a child’s ability to rapidly copy the 
letters of the alphabet and different words is moderately, but positively related to 
text quality. The competency to cope with complexity in novel situations seems 
to play a rather negligible role in this context, however. 

We incorporated all independent variables into three structural equa¬ 
tion models: one with a general factor, one with two factors (one that represents 
person- and one that represents text-related aspects), and one mediation model 
that assumes that the person-related variables influence the text-related ones. 
Even though the fit indices of all three alternatives were not high enough to 
make strong statements about the connections between all variables, the media¬ 
tion model contributed the most to answering our research question. The length 
as well as the legibility of a text seemed to influence the latent text factor to the 
greatest extent. 

Limitations 

Research studies of the writing process pose challenges for scholars that 
many other school-related topics do not (Griinke & Leonard-Zabel, 2015). Put- 
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ting one’s thoughts on paper involves coordinating multiple cognitive, linguistic, 
and physical operations along with considering genre-specific conventions and 
keeping the intended audience in mind (Troia & Graham, 2003). To identify 
variables within this intricate process that can be reliably measured and put into 
context with each other is very demanding. 

By nature, our study faced many of the same problems as other research 
in this area. To start with, we attempted to capture the quality of narratives by 
using a rating instrument that unfortunately cannot do justice to everything that 
constitutes text quality. Even though our raters achieved a remarkably high level 
of agreement, the fact remains that the validity of our instrument stays debat¬ 
able, since there is no objective external criterion for the quality of a story. In 
addition, we used undergraduate students as expert raters. It remains unknown 
whether more experienced teachers would have made similar appraisals. Another 
limitation pertains to the possibility that the results of our analyses might at least 
partially reflect assessment biases of university students when rating the quality 
of narratives. For example, we cannot determine to what extent handwriting 
influences text quality itself or (just) the appraisal of text quality. 

We chose to incorporate various student- and text-related variables de¬ 
rived from relevant theories of writing development. Even though we proceeded 
as objectively as possible, our decisions about which factors to include might 
not be completely beyond reproach. Thus, we cannot deny the possibility that 
other researchers might come to slightly different conclusions. Thus, we need to 
present our findings with a due degree of humility. 

Finally, our results cannot be generalized to populations or text genres 
other than the ones targeted in the current study. 

Practical Implications and Future Research 

Even though our findings are somewhat limited - especially with regard 
to their validity and their generalizability - they can provide practitioners with 
valuable clues about where to start as they try to support struggling writers at the 
beginning of secondary school. When composing argumentative, informative, 
or explanatory texts on an advanced level, relatively short essays are often viewed 
as being of better quality than lengthier ones (Koutsoftas, 2014). Elowever, this 
is not the case with narratives produced by children between 11 and 12 years 
old. As students develop initial composition skills while attending to stories as 
the most basic genre, length matters. Before they can revise and edit a writing 
product, students need to have enough material to work with. A third of all 
texts that our students handed in consisted of fewer than 80 words. According 
to a study by Rodriguez, Griinke, Gonzalez-Castro, and Cerezo (2014), this is 
an alarmingly low value for children of that age. Struggling students need sup¬ 
port in composing longer stories. In analyzing the process of writing, Rodriguez, 
Griinke, Gonzalez-Castro, Garda, and Alvarez-Garcia (2015) discovered that 
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children who come up with rather short texts invest remarkably little time in 
planning. They think about what to write while writing and revise their prod¬ 
ucts before submitting them, but they usually do not sit back first to collect their 
thoughts and take notes about what to put on paper and about what they want 
to communicate to their readers. Having to mind their spelling and handwrit¬ 
ing is challenging enough. If, in addition, students only start to contemplate 
the content of their story after they have started writing it, the assignment of 
producing a decent narrative will overburden them. 

One way of helping children to elaborate more on their stories involves 
instructing them on how to execute effective planning strategies. Prewriting ac¬ 
tivities (like using graphic organizers) that serve the purpose of generating ideas 
before composing the actual story are very beneficial. In a study by Hennes, 
Buyiiknarci, Rietz, and Griinke (2015), such an approach led to an effect size 
of Cohen’s d of 0.41. According to a meta-analysis by Gillespie and Graham 
(2014) as well as one by Rogers and Graham (2008), prewriting activities not 
only increase the number of total words written, but can also positively impact 
the quality of an essay. 

Graham (2010) highlighted the importance of effective handwriting 
instruction for enhancing the length and the quality of a story. An increased 
level of fluency enables children to invest a greater amount of mental effort into 
producing longer essays. If students learn not only to write faster but also to 
write more legibly (and more uniformly), this automation will further reduce 
the problem of having to attend to too many tasks at the same time. That is, a 
child who has invested a lot of time and energy into writing fluently and neatly 
can better attend to the content of a text. In a literature review, Graham (1999) 
identified several ways to improve a student’s handwriting both effectively and 
efficiently. Even though the ratio of orthographical errors in a text was not asso¬ 
ciated with its quality to the same extent as length and legibility, spelling instruc¬ 
tion would contribute to helping children focus on the content of their essay be¬ 
fore, during, and after composing it. According to a literature review by Sayeski 
(2011), an explicit rule-based approach that provides extensive opportunities of 
practice with corrective feedback is generally the best option. 

Future research should focus on replicating and expanding the results 
of this study through the use of different instruments and research designs. As 
mentioned, the NAEP Writing Scale for narrative texts is just one of several 
methods to capture the quality of a story. Prospective studies should consider 
different ways to measure how well a story is composed. In doing so, experts 
other than undergraduate students need to be used as raters as part of the vari¬ 
ance in the current study may be due to differences in the raters. 
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